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Claims: 



comprising: 



1 . (Currently Amended) A system for high dynamic range imaging 



an image sensor comprising an array of light-sensing elements, the image sensor 

1 



sensing anlimage of a scene and providing corresponding pixel values representing light 

! ; 

intensities jimpingmg on respective ones of the light-sensing elements, the image sensor 

providing k saturated pixel value when the intensity of light impinging on a conlesponding one of 
{ i 

the light-sensing elements is greater than a first threshold level and providing a blackened pixel 
value whe^i the intensity of light impinging on a corresponding one of the light-sensing elements 

i 1 

is below a jsecond threshold level, the image sensor having a low dynamic rangd relative to the 

t 

range of lijjht intensities of the image of the scene; 

I a mask interposed between the scene and the array of light-sensing elements of 

I i 

the image sensor, the mask having a multiplicity of light-transmitting cells that attenuate the 

i i 

intensity ojf scene light transmitted through the mask on to the light-sensing elements, wherein 

I ...!.- 

the light-tsansmitting cells are configured_s_o_ that the intensity of scene light trailsmitted on to the 

\ m I 

light sensible elements is attenuated by brightness level amounts that vary spatidllv across the 

I ! 

array of li^lit-sensing elements, and whereby the scene is exposed to the light sensing elements 

i . i 

in a spatially varying manner, oach oontrolling - tho - cxposuro of a r e sp e ctiv e on e I or mor e of th e 

? 1 
j 1 

light censing elements to light from th e sc e ne to provide gpatially -v ar^ing oxpoauro to the array 

i , 
1 J 

of light s e ising e l e m e ntSj- each of the light-sensing elements having a corresponding exposure 

i j 

value indicative of the transparency of the cell through which light impinging on the 



light-sensftig element passes; 
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I " 

! a first memory storing exposure values corresponding to the lightj-sensing 
} i 
elements; abd : 

an image processor coupled to the image sensor for receiving thelpixel values 
I | 
provided thereby and coupled to the first memory for receiving the exposure values 

I | 

corresponding to the pixel values, the image processor comprising a nonnalizer for mapping the 

pixel values* by a function of the exposure values to derive corresponding normalized pixel 

i 

values, i ! 



* 2. (Original) The system according to claim 1 , wherein the noxmalizer 

| : 

divides ea<jh of the pixel values with the exposure value corresponding to the light-sensing 

i ! 
element receiving light intensity represented by the pixel value to derive corresttonding 



normalized pixel values. 



I 3. (Original) The system according to claim 1, whereintthe exposure 

! ! 
values corresponding to the light-sensing elements are fixed and the image procbssor further 

1 

comprises Ian interpolator for interpolating the normalized pixel values to derive interpolated 

j : 

pixel values at respective positions of a second array overlapping the array of trie light-sensing 

! ! 

elements, i 1 



i 4. (Previously presented) The system according to claim 3, wherein 

the interpolator of the image processor interpolates said normalized pixel values, excluding said 
normalized pixel values corresponding to saturated pixel values or blackened pixel values. 

i i 
i 

i ! 

i » 
1 i 
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5. (Original) The system according to claim 3, whereui the interpolator 

, I 

of the image processor interpolates the normalized pixel values multiplied by respective 
weighting Values. ' 



! 6, (Original) The system according to claim 5, whereinjthe weighting 

i • 

values are Respective signal-to-uoise ratios of the corresponding pixel values. 

i 

I i 

: i 

V j 

j i 

S 7. (Original) The system according to claim 3, whereiii the interpolator 

i i 

of the image processor applies an interpolation filter to the normalized pixel values. 

i i 

i i 

8. (Original) The system according to claim 3 a wherein the light-sensing 
elements olf the array are disposed at respective intersections of a first grid definfed by spaced 



intersecting perpendicular lines extending in a vertical direction and a horizonta 



direction, and 



the interpolator derives interpolated pixel values at respective intersections of a second grid 
defined bySspaced intersecting perpendicular lines extending in the vertical direction and m the 
horizontal jiirection, the first and second grids overlapping one another. 



(Previously Presented) 



The system according to cljaim 8, wherein 



the interpolator of the image processor separately interpolates said normalized pixel values in 

i t ; 

each diffeifent region of the first grid, each region overlapping adjacent regions and 

! ! 
encompassing a predetermined number of intersections of the first grid. j 
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• 1 0. (Original) The system according to claim 9, wherein ithe mask 
i i 

comprises jrepetitively disposed identical groups of cells having different transparencies, 

i : 

[ 
i 

| i 

i 11. (Original) The system according to claim 1 0, whereiiji each of the 

| i 

repetitive!^ disposed identical groups of cells of the mask consists of four neighboring cells 

r i 

having different transparencies, each cell controlling the light exposure of a different one of the 

light-sensing elements, and the first and second grids have identical dimensions land are 

f ■ 
i i 

l i 
displaced from one another by one-half grid position in the horizontal direction and one-half grid 
i ' 
i | 
position injthe vertical direction. : 

t ; 
! i 

4 I 

I 

r | 

' i i. 

• 12. (Previously Presented) The system according to cl^im 9, wherein 

• i 

the interpolator of the image processor derives a respective interpolated pixel value in each 

i 

different region of the first grid by taking the average of all normalized pixel values in the region 

which do ijot correspond to-a said saturated pixel value or ft said b lackened pixel value. 

i \ 
t 

! 

i 

I 13. (Original) The system according to claim 1 further comprising a 

I ; 

second meinory storing a response function of the image sensor, wherein the im&ge processor is 
coupled to jfhe second memory for receiving the response function and further comprises a 

i j 

calibrator far converting the pixel values provided by the image sensor to linear response pixel 
values in accordance with the response function before the pixel values are normalized by the 

s ! 

normalized i 

I » 

i i 

1 I 

i i 
t I 
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; 14. (Original) The system according to claim 3 further comprising an 
i i 
output imaie memory coupled to the image processor for receiving and storing tjhe interpolated 

pixel values. I 



j 15, (Withdrawn) The system according to claim 1 further cc mprising a first 
lens sy$te4 located between the scene and the mask for projecting an image of tie scene onto the 

mask and a second lens system for projecting the image of the scene as transmitted through the 

i * 

t ; 

mask onto jthe array of light-sensing elements. j 



j 1 6. (Withdrawn) The system according to claim 15, further (comprising a 

r 1 

r 

! I 

light diffuger adjacent to the mask for removing directionality of light focused bjjr the first lens 



system. 



r > 

17. (Original) The system according to claim 1 , wherein jthe array of light 
sensing elements is a solid state device image sensing device. ! 



j 18. (Original) The system according to claim 17, wherein the solid state 
device is ai charge-coupled device light sensing array. 

| 19. (Original) The system according to claim 1 8, wherein the solid state 

i 

device is a CMOS light-sensing array- 



I 
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I 20. (Original) The system according to claim 1 7, whereii l the mask is 

I 

integrated yith the light-sensing elements on the same substrate. 



S 21. (Original) The system according to claim 1 , wherein khe mask is 

} ! 

made of a Nonlinear optical material. 1 

! 
i 

22. (Withdraw") A system for high dynamic range imaging) comprising: 

! an image sensor comprising an array of light-sensing elements, the image sensor 

j 

sensing an Image of a scene and providing corresponding pixel values representing light 

i 
1 

intensities impinging on respective ones of the light-sensing elements, the image sensor 

i 

providing a saturated pixel value when the intensity of light impinging on a corresponding one of 
the light-sejnsing elements is greater than a first threshold level and providing a Slackened pixel 
value wheijt the intensity of light impinging on a corresponding one of the light-iensing elements 
is below a second threshold level, the image sensor having a low dynamic ranges relative to the 

range of intensities of the image of the scene; 

j 

! a mask interposed between the scene and the array of light-sensing elements of 

I 

the image sensor, the mask having a multiplicity of light-transmitting cells each controlling the 

exposure cjf a respective one or more of the light-sensing elements to the light fi om the scene, 

I 

each of th4 light-sensing elements having a corresponding exposure value indicative of the 
transparency of the cells through which light impinging on the light-sensing element passes, the 
transparency of each of the cells of the mask being alterable by applying a respective exposure 
control simal to the mask; 
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I a mask controller coupled to the image sensor for receiving the pixel values 

i 

provided thereby and for computing, and applying to the mask, exposure contra signals for 

minimizing the number of saturated pixel values and blackened pixel values from the image 

sensor, and providing exposure values corresponding to the applied exposure control signals; and 
1 ! 
1 an image processor coupled to the image sensor for receiving the| pixel values 



pixel values by a 



provided tlereby, the image processor comprising a normalizer for mapping the 
function of the exposure values to derive corresponding normalized pixel valued 



23. (Withdrawn) The system according to claim 22, whereijn the normalizer 

j ! 

of the image processor divides each of the pixel values by the exposure value ccjrresponding to 

the light-sensing element receiving light intensity represented by the pixel value! to denve 

\ | 

corresponding normalized pixel values. 



: 24. (Withdrawn) The system according to claim 22, fuxtheit comprising an 

I ! 

exposure pSattern memory coupled to the mask controller for receiving and storing the exposure 

\ \ 

values, an4 wherein the image processor is coupled to the exposure pattern memory for receiving 



the exposure values corresponding to the pixel values from the image sensor. 



25. (Withdrawn) The system according to claim 22 further comprising an 



output imajge memory coupled to the normalizer of the image processor for receiving and storing 



the normalized pixel values. 



I 



26. (Withdrawn) The system according to claim 24 further pomprising: 



I 
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I a smoother coupled to the exposure pattern memory for receiving exposure values 

i 

stored therein and applying a smoothing filter to the exposure values to derive smoothed 
exposure vjalues corresponding to the normalized pixel values; j 

! an exposure reapplicator coupled to the normalizer of the image processor for 

1 i 
receiving tbe normalized pixel values and for multiplying each of the normalized pixel values 

with a corresponding smoothed exposure value to derive monitor image pixel values; and 

i 

f j 

j a monitor image generator coupled to the exposure reapplicator for providing the 

i ! 

monitor irriage pixel values. j 



! 27. (Withdrawn) The system according to claim 22, wherein the mask 

controller computes the exposure control signals to maximize the signal-to-noise ratio of the 

i | 

average piiel value provided by the image sensor. 

| i 

I I 

j 28. (Withdrawn) The system according to claim 22, wherei[i the mask 
controller Computes the exposure control signals to maximize the spatial smootlJness of the 

| ! 

exposure vjalues corresponding to the light-sensing elements of the image senso^. 



29. (Withdrawn) The system according to claim 22, whereik the mask 



comprises a liquid crystal array. 



| 30, (Withdrawn) * The system according to claim 22 further comprising a 

I | 
first lens system located between the scene and the mask for projecting an image of the scene 
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onto the m^sk and a second lens system for projecting the image of the scene as transmitted 

r ! 

through thej mask onto the array of light-sensing elements. 



; 31. (Withdrawn) The system according to claim 3 0 further comprising a 
light diffusbr adjacent the mask for removing directionality of light focused onto the mask. 



I 32. (Withdrawn) The system according to claim 22, whereiii the array of 

( 

light-sensing elements is a solid state image sensing device. 



I 33. (Withdrawn) The system according to claim 32, wherein the solid state 
image sensing device is a charge coupled device light-sensing array. 1 



I 34. (Withdrawn) The system according to claim 32, whereih the solid state 

I i 

image sending device is a CMOS light-sensing array. ; 



| 35. (Currently Amended) A system for high dynamic range imaging 

comprising: j 

j 

i an image sensor comprising an array of light-sensing elements, wherein the light- 

i ■ 

^elAnents are configured to have respective photosensitivities that vary spatially across 



sensing < 



the array si> that wh en the im age sensor is exposed to light from a scene for an exposure time 

i : 

then the array of light sensing elements impose a spatial variation the scene exp6sure, the image 

\ i 

sensor seniing an image of a scene and providing corresponding pixel values representing light 

| I 
intensities impinging on respective ones of the light-sensing elements, each light-sensing element 

i 
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having a respective first threshold level so as to cause the image sensor to provide a saturated 



pixel valuej when the intensity of light impinging on the light-sensing element is greater than the 
respective Jirst threshold level, each light-sensing element having a respective second threshold 

value so as! to cause the image sensor to provide a blackened pixel value when the intensity of 

» 

Jight impinging on the light-sensing element is below the respective second threshold level, the 

i . . ! 

image senior having a low dynamic range relative to the range of light intensitie's of the image of 

! i 

the scene, the light-sensing elements having respectiv e} spatially varying photosen s iftvi e sto 

\ 

incid e nt light and a corroqponding photosensitivity values indicative of &@ theirjrespective 

\ ; 
photosensitivities; ; 

j a first memory storing photosensitivity values corresponding to ejach of the 
I l 
\ I 
Hght-sensi^g elements; and 
* 

| an image processor coupled to the array of light-sensing elements for receiving 

| 

the pixel values provided by the image sensor and coupled to the first memory for receiving the 

i 
i 

photosensitivity values corresponding to the light-sensing elements, the image pfrocessor 

i 
j 

comprising a normalizer for mapping the pixel values by a function of the photosensitivity values 

l . . i . 

to derive corresponding normalized pixel values, and an interpolator for interpolating the 

[ ! 

normalized pixel values to derive interpolated pixel values at respective positions of a second 

1 ■ 
array overlapping the array of light-sensing elements. 



36. (Original) The system according to claim 35, wherejin the normalizer 



r 



of the image processor maps the pixel values by a function of the photosensitivity vaJues by 
dividing i 

element receiving ] 



each of the pixel values by the photosensitivity value corresponding to 
light intensity represented by the pixel value. 



the light-sensing 



-11- 



i 



NY02:488587.5 

PAGE 12/27 1 RCVD AT 6/30/2004 4:13:14 PM [Eastern Daylight Time] * SVR:USPT0-EFXRF-1I1 1 DNIS:8729306 * CSID: * DURATION (mm-$s):0M8 



A323b- 070050,0998 
PATENT 



37. (Original) The system according to claim 35, whereip the 



light-sensing elements of the image sensor are disposed at respective intersectiohs of a first grid 

l ; 

defined byispaced intersecting perpendicular lines extending in a vertical directipn and a 

| I 

horizontal direction, and the positions of the interpolated pixel values are respective intersections 

i 

of a second grid defined by spaced intersecting lines extending in the vertical direction and in the 

i 

horizontal pirection. i 



38. (Original) The system according to claim 37, wherein the 
interpolator of the image processor separately interpolates normalized pixel values in each 

| ; 

different region of the first grid, each region overlapping adjacent regions and encompassing a 

\ I 

predetermined number of intersections of the first grid, 

i 

i 

\ 39. (Original) The system according to claim 37, wherein the array of 

light-sensiig elements of the image sensor comprise repetitively disposed identical groups of 

I 

light-sensipg elements having different photosensitivities. 



i j 

j 40. (Original) The system according to claim 39, wherein each of the 

] 

repetitively disposed identical groups of light-sensing elements consists of fourineighboring 

! i 

light-sensing elements having different photosensitivities, and the first and second grids having 

i 

t i 
identical dimensions and are displaced from one another by one-half grid position in the 

horizontal [direction and one-half grid position in the vertical direction. ; 



i 
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I 41. (Previously Presented) The system according to claim 38, wherein 

the interpolator of the image processor derives a respective interpolated pixel value in each 

i 

different region of the first grid by taking the average of all normalized pixel values in the region 

which do rpt correspond to said saturated pixel value or a said blackened pixel value. 

i 

j 

i 42. (Original) The system according to claim 35, wherein the image 



sensor has 5a respective response function to light impinging on each of the light 



sensing 



J . - j 

elements and the system further comprises a second memory storing the respective response 

1 1 

t ; 

functions cjf the image sensor, and wherein the image processor is coupled to the second memory 

i . 

for receiving the response functions and further comprises a calibrator for converting the pixel 

values provided by the image sensor to linear response pixel values in accordance with the 

t 

respective response functions before the pixel values are normalized by the normalizes 



! 43, (Original) The system according to claim 35, further comprising an 
output imaige memory coupled to the image processor for receiving and storing he interpolated 

i 1 

pixel values. 



44. (Currently amended) A method for high dynamic range imaging 



comprising the steps of: 



exposing an image sensor comprising an array of light aonsing 0] omenta to light 



from a scene to sense an image frame, wherein the image sensor comprises an array of light 



j 

sensing elements that is configured so that a sensing capability of the image sensor varies 



spatially across the array during the sensing of the image frame, whereby die sensed image frame 
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i I 
is an image formed with a uoing a spatially varying exposure of the scene, the image sensor 

i. j 

sensing th£ spatially varying exposure image and providing corresponding pixel values 
representirig light intensities impinging on respective ones of the light-sensing elements, the 
image senior providing a saturated pixel value when the intensity of light impinjging on a 

» i 

corresponding one of the light-sensing elements is greater than a first threshold level and 

I i 

providing i blackened pixel value when the intensity of the light impinging on at corresponding 

i i 

one of the jLight-sensing elements is below a second threshold level, the image sensor having a 

j I 
low dynamic range relative to the range of light intensities of the image of the scene; and 

i 



normalizing the pixel values provided by the image sensor with respect to the 



spatially varying exposure of the scene bv the light-sensing elements to derive corresponding 

i i 
normalized pixel values. j 



I 45 . (Original) The method according to claim 44, wherein the step of 

i ' 

: i 

exposing die image sensor using a spatially varying exposure includes the step d fusing a mask 
having a Multiplicity of light transmitting cells each controlling the exposure of a respective one 



or more ofjthe light-sensing elements of the image sensor to light from the scene, each of the 
light-sensiig elements having a corresponding exposure value indicative of the transparency of 

the mask csll through which light impinging on the light-sensing element passes and the step of 

j 

uormalizirjjg the pixel values provided by the image sensor includes the step of mapping the pixel 
values by 3 function of the exposure values to derive corresponding normalized pixel values. 



1 

l 
t 

| 46. (Original) The method according to claim 45, wherei i the step of 
mapping trie pixel values by a function of the exposure values comprises dividing each of the 

i 

7 
I 

j -14- 

% 

I 
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pixel vaJuejs with the exposure value corresponding to the ligbt-sensing element ireceiving light 
intensity represented by the pixel value. 

47. (Original) The method according to cJaim 44, wherein the exposure 



values corresponding to the light-sensing elements are fixed, and further compri 



sing the step of 



interpolating the normalized pixel values to derive interpolated pixel values at respective 

\ I 
positions ojf a second array overlapping the array of the light-sensing elements, j 



48. (Original) The method according to claim 44, wherein the step of 



interpolating the normalized pixel values include the step of applying an interpolation filter to the 
normalized pixel values. ; 



49. (Previously Presented) 



The method according to claim 47, wherein 



the step of [interpolating said normalized pixel values includes the steps of separately 

! 

interpolating said normalized pixel values in each different region of the array ot the 

light-sensing elements, each Tegion overlapping adjacent regions and encompassing a 

t ' 

predetermi ned number of the light-sensing element positions. j 

i 
* 

j 50. (Previously Presented) The method of claim 49, wherein the steps 

\ 

of separately interpolating normalized pixel values in each different region of thp array of 

r 
■ 

tight-sensing elements each include the step of taking the average of all normalized pixel values 

i 

in the region, except for ones that correspond to said saturated pixel value or sai 3 blackened 
pixel valus, to derive a respective one of the interpolated pixel values. 
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! ! 

j 51. (Onginal) The method of claim 44 further comprising the step of 
calibratingjthe pixel values provided by the image sensor according to a response function of the 
image senior to derive linear response pixel values before the step of normalizirig the pixel 

j ! 

values. j I 



i 52. (Original) The method according to claim 47 further comprising the 
step of stoning the interpolated pixel values in an output image memory. 



53. (Original) The method of claim 45 further comprisinjg the steps of 



projecting kn image of the scene onto the mask, and projecting the image of the scene as 

I » 

transmitted through the mask onto the array of light-sensing elements. ] 



I 

54. (Withdrawn) The method of claim 53, wherein the step : of projecting the 



image of the scene as transmitted through the mask onto the array of light-sensii)g elements 



includes projecting the image of the scene as transmitted through the mask and a light diffuser 

* 1 

onto the artay of light-sensing elements. J 



55. (Withdrawn) The method of claim 45, wherein the exposure value 
correspondiing to each light-sensing element is alterable by applying a respective exposure 

i j 

control signal to the mask, and further comprising the steps of: ' 
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computing from the pixel values provided by the image sensor e? posure control 
signals forjminimizing the number of saturated pixel values and blackened pixc values from the 



image senior; 



applying the computed exposure control signals to the mask; and 

providing exposure values corresponding to the applied exposure! control signals 



for use in the normalizing step. 



\ 56. (Withdrawn) The method according to claim 55 further! comprising the 

| i 

step of storing the normalized pixel values in an output image memory. 

! 



steps of: 



57. (Withdrawn) The method according to claim 55 further comprising the 



smoothing the exposure values corresponding to the applied exp ssure control 



signals by applying a smoothing filter to the exposure values to derive smoothed exposure values 
corresponcjing to the normalized pixel values; 

j reapplying the smoothed exposure values to the normalized pixej values by 

multiplying each normalized pixel value with a corresponding smoothed exposure value to 

* 

r 
f 

derive monitor image pixel values; and 

f ; 
j storing the monitor image pixel values in a monitor image memory* 



58. (Withdrawn) The method of claim 55, wherein the step 'of computing 
exposure cbntrol signals comprises computing exposure control signals to maxujnize the 
signal-to-nbise ratio of the average pixel value provided by the image sensor. 
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59. (Withdrawn) The method according to claim 55, wherein the step of 

* i - . 

computing exposure control signals comprises computing exposure control signals to maximize 
the spatial [smoothness of the corresponding exposure values. * 



| 60, (Withdrawn) A method for high dynamic range imaging comprising the 

i ! 

steps of: | 

I 

| exposing a frame of photographic film to an image of a scene thipugh a mask 

i 

having a niultiplicity of light transmitting cells controlling the exposures of respective regions of 

i I 

J | 

the film toj light from the scene, each of the respective regions of the film having a corresponding 

i i 

exposure vjalue indicative of the transparency of the masked cell through which (light impinging 

i 

on the regijon passes; 

! storing the exposure values corresponding to the respective regie ns of the film; 

j 

processing the film to develop a masked image contained thereom or on a print 



thereof; 



scanning the processed film or a print thereof with an image scanner to derive 



pixel values corresponding to the respective regions of the film or a print thereojf; and 

normalizing the pixel values from the scanner using the stored exposure values to 



derive nor|nalized pixel values. 



| 61. (Withdrawn) The method according to claim 60 further comprising the 
step of interpolating the normalized pixel values to derive interpolated pixel values. 
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62. (Withdrawn) The method according to claim 6 1 furtherjcomprising the 



step of stalling the interpolated pixel values in an output image memory. 



| 63. (Withdrawn) The method of claim 60 further comprisin g the step of 

i 

aligning the pixel values corresponding to the respective regions of the film or al print thereof 

i . . i 

with the esiposure values corresponding to the respective regions. ' 



1 64. (Withdrawn) The method according to claim 60 fuitheT comprising the 
step of calibrating the pixel values corresponding to the respective regions of th£ film or a print 
thereof in jccordance with a response function of the film, the image scanner anjd a printer, if 
any, to derive linearized pixel values before the step of normalizing the pixel values. 



t 
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